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(54) Fibre channel switch employing distributed queuing 



(57) The present invention is a fibre channel switch 
employing a distributed queuing algorithm for intercon- 
necting a plurality cf devices (workstations, supercom- 
puter, peripherals) through their associated node ports 
(N_ports) and employs a fabric having a shared memory 
coupled to a plurality of fabric ports (F_ports) through a 
bi-directional bus over which memory addresses, frame 
data and communications commands are transmitted. 



Each F_port includes a port controller employing a dis- 
tributed queuing algorithm associated with a control net- 
work for communicating commands between the ports 
related to when and where frame transfers should be 
made, wherein the bi-directional bus provides an inde- 
pendent data network for access to the shared memory 
such that frames can be transferred to and from the 
shared memory in response to port controller com- 
mands. 
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Description 

FIELD OF THE INVENTION 

The present invention relates an apparatus for dis- 
tributed source and destination queuing in a high per- 
formance memory based switch and, more particularly, 
to a Fibre channel switch having a distributed queuing 
algorithm. 

BACKGROUND OF THE INVENTION 

Mainframes, super computers, mass storage sys- 
tems, workstations and very high resolution display sub- 
systems are frequently connected together to facilitate 
file and print sharing. Common networks and channels 
used for these types of connections oftentimes intro- 
duce communications bottle necking, especially in cas- 
es where the data is in a large file format typical of graph- 
ically-based applications. 

There are two basic types of data communications 
connections between processors, and between a proc- 
essor and peripherals. A "channel" provides a direct or 
switched point-to-point connection between communi- 
cating devices. The channel's primary task is merely to 
transport data at the highest possible data rate with the 
least amount of delay. Channels typically perform sim- 
ple error correction in hardware. A "network," by con- 
trast, is an aggregation of distributed nodes (e.g., Work- 
stations, mass storage units) with its own protocol that 
supports interaction among these nodes. Typically, 
each node contends for the transmission medium, and 
each node must be capable of recognizing error condi- 
tions on the network and must provide the error man- 
agement required to recover from the error conditions 

One type of communications interconnect that has 
been developed is Fibre Channel. The Fibre channel 
protocol was developed and adopted as the American 
National Standard for Information Systems (ANSI) . See 
Fibre Channel Physical and Signaling Interface, Revi- 
sion 4.2, American National standard for Information 
Systems (ANSI) (1993) for a detailed discussion of the 
fibre channel standard. Briefly, fibre channel is a 
switched protocol that allows concurrent communica- 
tion among workstations, super computers and various 
peripherals. The total network bandwidth provided by fi- 
bre channel is on the order of a terabit per second. Fibre 
channel is capable of transmitting frames at rates ex- 
ceeding 1 gigabit per second in both directions simulta- 
neously. It is also, able to transport commands and data 
according to existing protocols such as Internet protocol 
(IP), small computer system interface (SCSI), high per- 
formance parallel interface (HIPPI) and intelligent pe- 
ripheral interface (I PI) ever both optical fiber and copper 
cable. 

Fig. 1 illustrates a variable-length frame 11 as de- 
scribed by the Fibre Channel standard. The variable- 
length frame 1 1 comprises a 4-byte start-of-f rame (SOF) 



indicator 12, which is a particular binary sequence in- 
dicative of the beginning of the frame 1 1 . The SOF indi- 
cator 12 is followed by a 24-byte header 14, which gen- 
erally specifies, among other things, the frame source 
$ address and destination address as well as whether the 
frame 1 1 is either control information or actual data. The 
header 14 is followed by a field of variable-length data 
16. The length of the data 16 is 0 to 2112 bytes. The 
data 16 is fol towed successively by a 4-byte CRC (cy- 
io clicai redundancy check) code 17 for error detection, 
and by a 4 byte end-of-frame (EOF) indicator 18. The 
frame 11 of Fig. 1 is much more flexible than a fixed 
frame and provides for higher performance by accom- 
modating the specific needs of specific applications. 

FIG. 2 illustrates a block diagram of a representa- 
tive fibre channel architecture in a fibre channel network 
100. A workstation 120, a mainframe 122 and a super 
computer 1 24 are interconnected with various subsys- 
tems (e.g., a tape subsystem 126, a disk subsystem 
126, and a display subsystem 130) via a fibre channel 
fabric 110 (i.e. fibre channel switch). The fabric 110 is 
an entity that interconnects various node-ports 
(N_ports) 140 and their associated workstations, main- 
frames and peripherals attached to the fabric 110 
through the F_ports 142. The essential function of the 
fabric 110 is to receive frames of data from a source 
N_port and, using a first protocol, route the frames to a 
destination N_port. In a preferred embodiment, the first 
protocol is the fibre channel protocol. Other protocols, 
such as the asynchronous transfer code (ATM) could be 
used without departing from the scope of the present 
invention. 

Essentially, the fibre channel is a channel-network 
hybrid, containing enough network features to provide 
the needed connectivity, distance and protocol multi- 
plexing, and enough channel features to retain simplic- 
ity, repeatable performance and reliable delivery. Fibre 
channel allows for an active, intelligent interconnection 
scheme, known as a "fabric," or fibre channel switch to 
connect devices. The fabric includes a plurality of fabric- 
ports (F_ports) that provide for interconnection and 
frame transfer between a plurality of node-ports 
(N_ports) attached to associated devices that may in- 
clude workstations, super computers and/or peripher- 
als. The fabric has the capability of routing frames based 
upon information contained within the frames. The 
N_port manages the simple point-to-point connection 
between itself and the fabric. The type of N_port and 
associated device dictates the rate that the N_port 
transmits and receives data to and from the fabric. 
Transmission is isolated from the control protocol so that 
different topologies (e.g., point-to-point links, rings, 
multidrop buses, cross point switches) can be imple- 
mented. 

The Fibre Channel industry standard also provides 
for several different types of data transfers. A class 1 
transfer requires circuit switching, i.e., a reserved data 
path trough the network switch, and generally involves 
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the transfer of more than one frame, oftentimes numer- 
ous frames, between two Identified network elements. 
In contrast, a class 2 transfer requires allocation of a 
path through the network switch for each transfer of a 
single frame from one network element to another. s 

Frame switching for class 2 transfers is more diffi- 
cult to implement than class 1 circuit switching as frame 
switching requires a memory mechanism for temporarily 
storing incoming frames in a source queue prior to their 
routing to a destination port, or a destination queue at a 10 
destination port. A memory mechanism typically in- 
cludes numerous input/output (I/O) connections with as- 
sociated support circuitry and queuing logic. Additional 
complexity and hardware is required when channels 
carrying data at different bit rates are to be interfaced. is 

It is known to employ centralized queuing that is in- 
herently slow as a common block of logic must be em- 
ployed for all routing decisions wfthin the switch. 

It is also known to employ distributed source queu- 
ing which has apparent disadvantages when the frame 20 
at the head of the queue is destined to a port that is 
already forwarding a frame such that the path is blocked 
and the frame cannot be transferred. Alternatively, it is 
known to employ distributed destination queuing, which 
has the apparent disadvantage of a large destination 25 
queue at each port as it is possible for all frames within 
the switch to be simultaneously queued to the same 
destination port. 

Another disadvantage of distributed destination 
queuing is apparent when the frame at the end of the 30 
head of the queue is sourced from a port that is already 
forwarding a frame such that the path is blocked and the 
frame cannot be transferred. 

Thus, a heretofore unaddressed need exists in the 
industry for new and improved systems for implement- 35 
ing the Fibre Channel industry standard for class 2 
transfers on fiber optic networks with much higher per- 
formance and flexibility than presently existing systems. 
Particularly, there is a significant need for a method and 
apparatus that combines both distributed source and 40 
destination queuing in a high performance memory 
based switch. 

A need also exists to implement distributed queues 
between the source and destination ports, requiring the 
lower queue storage resources of source queuing, but 45 
providing the high tnroughput of destination queuing 
and avoiding "head-of-line" blocking of either source or 
destination queuing. 

It would be desirable and of considerable! advan- 
tage to provide a Fibre channel switch that provides for so 
efficient transfer of queuing information between Fibre 
channel ports, especially if the new switch provided an 
improvement in any of the following areas: increased 
bandwidth, decreased no-load latency and increased 
throughput under load (due to parallelism of distributed ss 
queuing). 

It will be apparent from the foregoing that there is 
still a need for a High-Bandwidth memory-based switch 



employing distributed queuing that differs from that em- 
ployed in existing centralized Fibre Channel switch ar- 
chitectures. 

SUMMARY OF THE INVENTION 

In accordance with. the invention, there is provided 
a fibre channel switch employing distributed source and 
destination queuing for interconnecting a plurality of de- 
vices (workstations, supercomputer, peripherals) 
through their associated node ports (N .ports). The fibre 
channel switch provides a fabric having a shared mem- 
ory coupled to a plurality of fabric ports (F .ports) 
through a bit-slicing memory controller over which mem- 
ory addresses, frame data and. communications com- 
mands are transmitted. Each F__port includes a port con- 
troller employing a distributed queuing algorithm asso- 
ciated with a control network for communicating com- 
mands between the ports related to when and where 
frame transfers are to be made. The bit-slrcing memory 
controller provides an independent data network for ac- 
cess to the shared memory such that frames can be 
transferred to and from the shared memory in response 
to port controller commands. 

Each port controller further comprises a link control- 
ler (LC) for controlling the optical interface with the 
N_port, a frame transfer controller (FTC) for receiving 
and transmitting data between the LC and the shared 
memory, an address validation Aranslation controller 
(AVTC) for obtaining frame header information and for 
generating destination port numbers, buffer numbers, 
and timeout values, and a writer and reader that togeth- 
er implement distributed source/destination queuing, a 
synchronizer (sync) for synchronizing port state transi- 
tions and the activities of the reader and writer, a statis- 
tics controller (SC) for counting statistics, and a port 
communications controller (PCC) for enabling port con- 
trollers to communicate. 

Other aspects and advantages of the present inven- 
tion will be come apparent from the following detailed 
description, taken in conjunction with the accompanying 
drawings, illustrating by way of example the principles 
of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic representation of a variable- 
length frame communicated through a fiber optic 
switch of a fiber optic network in accordance with 
the Fibre Channel industry standard; 
FIG. 2 depicts a block diagram of a representative 
Fibre Channel architecture. 
FIG . 3 illustrates a block diagram of a Fibre Channel 
switch according to the present invention. 
FIG. 4 illustrates a block diagram of a port controller 
located within the Fibre Channel switch illustrated 
in FIG. 3. 

FIG. 5 illustrates the data organization for a bit- 
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sliced memory in accordance with the invention as 
embodied in a simplified four port fibre channel 
switch. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Briefly, the present invention provides a Fibre Chan- 
nel switch based upon a distributed queuing algorithm 
for interconnecting a plurality of devices through their 
associated node ports (N_ports). The fibre channel 
switch provides a fabric having a shared memory cou- 
pled to a plurality of fabric ports (F_ports) through a bit- 
slicing shared memory controller through which memory 
addresses, frame data are transmitted. The Fibre Chan- 
nel switch supports both circuit and frame switched con- 
nections for multiple baud rate interfaces. 

FIG. 3 illustrates a block diagram of an Fibre Chan- 
nel switch 300 having eighteen ports 305 numbered Port 
1 to Port 18 (only Port 1 , Port 2, Port 17 and Port 18 are 
illustrated) coupled to a 512 kByte shared memory 330 
through a bit-slicing memory controller 340. Each of the 
eighteen ports 305 include a port controller 310 having 
memory address (ADD) lines 31 2 for transmitting mem- 
ory addresses and Rx lines 31 3 for transmitting frame 
data to the bit-slicing memory controller 340, and Tx 
lines 314 for receiving frame data from the bit-slicing 
memory controller 340, and an OLM/GLC media adapt- 
er 315 for interfacing to the Fibre channel. 

A bit-sliced memory architecture is disclosed in U. 
S. Patent Application Serial No. 08/330,279, filed Octo- 
ber 27, 1994 and entitled 'Channel Module for a Fibre 
Optic Switch with Bit Sliced Memory Architecture for Da- 
ta Frame Storage" by Dwayne Bennett and is hereby 
incorporated by reference. The memory architecture 
disclosed in 08/330,279 teaches only bit slicing of the 
Rx frame data. The preferred embodiment of the inven- 
tion employs bit-slicing of both the Rx frame data and 
the Tx frame data. This allows the shared memory 330 
to be used not only for data frame storage, but also for 
the multiplexing function delivered by the bit-slicing 
memory controller 340. 

An independent communications command bus 
315 provides interconnections between the eighteen 
port controllers 310 and is employed for sending com- 
munication commands related to the timing and desti- 
nation of frame transfers. The switch 300 also includes 
a single non-core port controller 325 interconnected with 
each port controller 310 over a micro controller bus 327. 

FIG. 4 illustrates a block diagram of a port controller 
310 illustrated in FIG. 3, comprising a link controller (LC) 
410, a frame transfer controller (FTC) 420, an address 
validation /translation controller (AVTC) 430. a writer 
440 and reader 450, a synchronizer (sync) 460, a sta- 
tistics controller (SC) 470, and a port communications 
controller (PCC) 480. 

The link controller 410 further comprises a control 
processor for OLC control (lock-to-ref, loopback control, 



etc.), elastic store, 8B/10B conversion, work synchroni- 
zation, ordered set encoding/decoding, port state ma- 
chine (offline to online protocol, link recovery handshak- 
ing, etc.), CRC generation and checking, and frame val- 
s idation. 

The FTC 420 is an interface for receiving and trans- 
mitting data between the LC 410 and the shared mem- 
ory controller 340. Upon receipt of data from the LC 41 0, 
the FTC 420 forwards the memory address and the data 

10 to the shared controller memory 340. The memory ad- 
dress is based on the available source buffers. The FTC 
420 tells the writer 440 which destination port and re- 
ceive buffer the frame has been put in via the address 
validation/translation controller (AVTC) 430, such that 

is the designated receive buffer will not be reused until the 
reader 440 tells it to reclaim the receive buffer. When 
transmitting data, the FTC 420 gets a message from the 
reader 450 (originating from the control network, 
through the port communication controller 480) to re- 

20 trieve a frame from the shared memory 330 and send it 
to the destination F_port via the LC 410 and the OLC 
315. The FTC 420 determines the memory address from 
the source port and buffer number contained in the mes- 
sage from the reader 450. When the FTC 420 passes 

& the EOF to the LC 410, it signals the reader 450 to indi- 
cate that the transfer is complete. 

The AVTC 430 gets frame header information of in- 
bound frames from the FTC 420. The frame header in- 
formation includes: SOF, frame header words 1 and 2, 

30 and buffer number. The AVTC 30 also generates the fol- 
lowing outputs to the writer 440: a destination port 
number, buffer number, forward frame timeout value, 
and busy frame timeout value and a flag indicating if the 
frame would be forwarded or rejected/discarded. The 

35 writer 440 and reader 450 of each port controller in the 
switch together implement distributed source/destina- 
tion queuing. Each source port maintains a separate 
queue for each destination port, and each queue con- 
tains only frames received by that particular source port, 

40 resulting in a separate queue for each source/destina- 
tion port combination in the switch. The queues are dis- 
tributed because each source port passes the buff er de- 
scriptor at the head of its destination queues to the des- 
tination port before the source port is actually ready to 

45 forward the frame. Thus, the destination port knows 
about the next frame that each of the source ports wants 
to forward to it next. 

When the destination port begins forwarding a 
frame from a particular source port, the destination port 

so requests the next buffer descriptor in the source port 
queue. Depending on the latency of the request and re- 
sponse between the two port controllers and the length 
of the frame being transmitted, the destination port will 
get the next buffer descriptor before or at approximately 

ss the same time transmission of the current frame com- 
pletes. By overlapping these two operations, a very high 
rate of sustained bandwidth can be maintained between 
two ports sending frames back and forth to each other. 
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When the destination port has seen the EOF command 
go out, the destination port sends a message to the 
source port telling the source port to free up the source 
buffer and send a receiver ready (RRDY) command. 

Source blocking does not occur in a shared memory s 
architecture as the destination port is free to choose a 
buffer from any source port. The destination port is 
therefore free to use any forwarding priority scheme the 
destination port desires. A simple round-robin scheme 
is employed for fairness. Alternatively, a priority scheme io 
may be employed that gives higher priority toa particular 
source port or to pace the traffic from a source port that 
is flooding the destination port with frames (i.e., class 3 
traffic that isnl paced by end-to-end flow control) by 
servicing it less often than the other ports, for example, is 
based on traffic history. The source prioritizes frames to 
each destination port based on frame type. For exam- 
ple, link control frames may be given higher priority than 
data frames in a simple first-come first-serve scheme. 

Upon passing a buffer descriptor to the destination 20 
port, the source port controller must remember the 
frame. In particular, a busy frame signal must be sent 
back to source N_Port, or the frame must be discarded 
if the frame cannot be forwarded out of the destination 
port within some fixed time. I n the preferred embodiment 25 
of the invention, the source port has responsibility for 
timing the frame upon passing of the buffer descriptor. 
Alternatively, the destination tort may have responsibil- 
ity for timing the frame and will forward a request to the 
source port to return a busy frame signal when the timer 30 
times out The source port may be link reset, requiring 
the contents of the buffer to be discarded. The source 
port therefore still needs to be able to stop the destina- 
tion port from forwarding the frame, and the same race 
condition exists between the destination port starting to 35 
forward the frame and the source port telling the desti- 
nation port not to forward. The source port retains re- 
sponsibility for timing the frame as the source port must 
time the frame until the source port buffer descriptor 
makes it to the head of the queue and is passed to the 40 
destination port. 

When a port goes offline, there is a period of time 
during which the switch hardware must reject frames on 
its own until the address validation tables are updated 
by software. Rather than requiring a source port control- 45 
ler to be aware of the port state of all the other ports, 
frames will continue to be requested by the port control- 
ler of the offline port, and it will respond to a buffer de- 
scriptor from the source with a reject message. This also 
applies to frames sent to a port that is in link recovery, so 

The amount of logic required in the FTC portion of 
the port controller is reduced as the source tort is not 
required to generate busy and reject frame commands. 
Instead, the buffer descriptor of the frame to be busied 
or rejected is queued to a "non-core" port controller 325 ss 
(FIG. 3) having an imbedded processor 326. Software 
is employed to manipulate the frame header, and queu- 
ing the frame back out to the original source port. While 



the original frame is queued to the "nonKx>re" port con- 
troller 325, the source continues to time the frame. If the 
frame is not forwarded within a predetermined period of 
time, the source port makes a request to the "non-core" 
port controller 325 not to forward the original frame to 
the processor. If the frame does make it the processor, 
and the reject/busy frame is queued back to the source, 
the "non-core" port controller must time the frame and 
discard it if necessary. In the preferred embodiment, the 
timer within the "non-core" port controller should take 
into account the time between when the frame was first 
queued to the "nonKX>re" port controller 325 and when 
it was actually delivered to it. The buffer information 
passed to the "non-core" port controller 325 includes a 
time stamp. The processor time stamps frames upon re- 
ceipt such that a time out value can be calculated that 
will ensure that in the worst case, the frame is discarded 
within R_A_TOV. 

A synchronizer (sync) 460 is employed or synchro- 
nizing port state transitions and the activities of the read- 
er 450 and writer 440. For example, when a port goes 
into link recovery, the synchronizer 460 prevents the link 
controller 410 from taking the link active again until the 
writer has freed up ail of the source buffers by either 
discarding the frames or waiting for a destination to com- 
plete transmission of a frame. The synchronizer 460 al- 
so waits for the reader to recognize that the port is no 
longer active and aborts the current forward operation 
or waits until it is finished. The synchronizer 460 does 
basically the same thing when the port goes offline or 
into link failure, but it must also wait for software to tell 
it that the port has been logged out of the fabric before 
allowing the link controller 410 to take the link back on- 
line. 

The statistics controller (SC) 470 is located be- 
tween the reader/writer and the LC/FTC such that it can 
count statistics, and pass information through, for ex- 
ample, when the writer 440 releases a buffer, the SC 
470 tells the FTC 420 that the buffer space is available 
and also tells the LC 410 to send a receiver ready 
(RRDY) signal. When the reader 450 decides a frame 
can be forwarded, the SC 470 is given the source port 
and buffer number information, allowing it to count 
frames transmitted on a per destination port baisis, and 
it also passes the information on to the frame transfer 
controller so it calculates the shared memory address 
of the frame data. The SC 470 connection to the FTC 
420 and LC 410 would also allow Fibre channel class 
one error and word count statistics to be counted if re- 
quired. 

The port communication controller (PCC) 480 al- 
lows port controllers 310 to communicate with one an- 
other. More specifically, writers 440 communicate with 
readers 450 and vice-versa, but readers 450 don't com- 
municate with one another, nor do writers 440. Each port 
controller 310 has a single serial output line that is con- 
nected to all the ports (including itself so that an N_Port 
can send frames to itself). In an 18 port switch, each port 
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controller will have one serial output and 1 8 serial inputs. 
Messages must include the intended destination port 
number so that the destination ports can ignore mes- 
sages that are not addressed to it. The source port 
number need not be included, it is implicit based on 
which serial input the message was received from. The 
serial lines would be clocked at 26 or 53 Mhz. 

FIG. 5 illustrates data organization for a bit-sliced 
memory in accordance with the invention as embodied 
in a simplified four port fibre channel switch. BO to B7 
indicates bytes 0 through 7 accumulated over eight 
clock cycles. The numbers in the memory locations in- 
dicate bit positions. A write to a memory location is six- 
teen bits wide (eight two bit slices, from eight bytes are 
concatenated), meanwhile, all four memories are writ- 
ten at the same time. Each read cycle delivers eight 
bytes of data corresponding to a particular port as di- 
rected by a shared memory controller. 

While the invention has been described and illus- 
trated with reference to specific embodiments employ- 
ing four ports and a 512kByte shared memory, those 
skilled in the art will recognize that modification and var- 
iations may be made such that the invention is equally 
applicable to much larger numbers of ports and memory. 



Claims 

1 . A fibre channel switch for interconnecting a plurality 
of devices, each device having a node port 
. (N_port), such that frames of data originating from 
a source port having a source N_port may be trans- 
ferred through the fibre channel switch to a destina- 
tion device having a destination N_port in accord- 
ance with a distributed source and destination 
queuing algorithm, comprising: 

a plurality of fabric ports (F_ports), each F_port 
coupled to a different device through the corre- 
sponding source or destination N_port, 
a plurality of port controllers, each port control- 
ler located on a different F_port, each port con- 
troller further comprising a distributed source 
and destination queuing algorithm for queuing 
frames sourced or destined from a device, or 
to, itself, and wherein, each port controller op- 
erates independently of the frame queuing by 
any other port controller, 
a control network for communicating timing and 
destination commands between each port con- 
troller corresponding to when and where frame 
transfers are to be made, 
a shared memory controller coupled to each 
port controller, for bit-slicing data and memory 
addresses being transmitted between the port 
controllers and the shared memory, wherein 
data and destination addresses are transferred 
to and from the shared memory, 



a bit-sliced shared memory having a common 
pool of memory buffers coupled to each F_port 
through the shared memory controller, wherein 
each F_port can access the shared memory di- 
s rectly. 

2. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 1 , the bit-sliced shared memory be- 
to ing bit-sliced to degree n, and the common pool of 

shared memory is constructed from n blocks of 
common memory, each with a memory bandwidth 
mb, given by: mb = (2 x b x p)/n, where b is equal 
to the data bandwidth of a single F_port, p is equal 
is to the number of F_ports and n represents the de- 
gree of bit-slicing. 

3. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 

20 claimed in claim 2, wherein, each port delivers and 
receives 1 bit of data at a time to, and from, each 
memory bank, and over 2p clock cycles these bits 
are accumulated, and wherein, every F_port has 
access to the shared memory. 

25 

4. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 1 , each port controller further com- 
prising a writer and a reader, each writer further con - 

30 taining a separate destination queue for each des- 
tination port, wherein each source port passes the 
buffer descriptor at the head of its destination 
queues to the destination port before the source 
port is actually ready to forward the frame such that 

35 each destination port knows about the next frame 
that each of the source ports wants to forward next 

5. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 

40 claimed in claim 4, wherein upon forwarding a frame 
from a particular source port to a device, the desti- 
nation port requests the next buffer descriptor in the 
source port queue, and wherein, depending on the 
latency of the request and response between the 

45 two port controllers and the length of the frame be- 
ing transmitted, the destination port will get the next 
buffer descriptor before or at approximately the 
same time transmission of the current frame com- 
pletes, and wherein, by overlapping these two op- 

so erations, a very high rate of sustained bandwidth 
can be maintained between two ports sending 
frames back and forth to each other. 

6. The fibre channel switch employing a distributed 
65 source and destination queuing algorithm as 

claimed in claim 2, wherein p=18 F_ports and 
b=800 Mbits/sec, n=36 memory devices and 
mb=B00 Mbits/sec, and wherein, the toe side of all 
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ports retrieve data directly from the same memory 
which the rx side accesses. 

7. The fibre channel switch employing a distributed 
source and destination queuing algorithm as s 
claimed in claim 1 , each port controller further com- 
prising: 

a link controller (LC) for controlling the link be- 
tween the N _port and the F_port, 1 o 
a frame transfer controller (FTC) for receiving 
and transmitting data between the LC and the 
shared memory, 

an address validation/translation controller 
(AVTC) for obtaining frame header information is 
and for generating destination port numbers, 
buffer numbers, and timeout values, 
a synchronizer (sync) for synchronizing port 
state transitions and the activities of the reader 
and writer, a statistics controller (SC) for count- 20 
ing statistics, and 

a port communications controller (PCC) for en- 
abling port controllers to communicate. 

8. The fibre channel switch employing a distributed 25 
source and destination queuing algorithm as 
claimed in claim 7, the address validation/transla- 
tion controller further comprising: 

a timer for timing and timeout handling of 
frames in the queue, such that upon passing a buff- 30 
er descriptor to the destination F _port, the port con- 
troller from the source F_port remembers the frame. 

9. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 35 
claimed in claim 8, wherein the port controller, in re- 
sponse to the timer, sends a busy frame signal back 

to the source N_Port, or discards the frame, if the 
frame cannot be forwarded out to the destination 
F_port within a fixed time period. 40 

10. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 9, wherein the fixed time period is 
determined in accordance with the Fibre channel 
standard. 

11. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 10, wherein the source F_port re- so 
tains responsibility for timing the frame until the 
source F_port bufler descriptor makes it to the head 

of the source queue and is passed to the destination 
queue, such that the destination port may now for- 
ward a request to the source F_port to return a busy ss 
frame signal. 



source and destination queuing algorithm as 
claimed in claim 9, further comprising the step of 
link resetting the source F_port and discarding the 
contents of the buffer, and wherein, the source 
F_port stops the destination F_port from forwarding 
the frame. 

13. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 2, the plurality of port controllers 
further comprising a "non-core function port" port 
controller, wherein, the buffer descriptor of the 
frame to be busied or rejected is queued to the "non- 
core function port" port controller, wherein the 
source F_port is not required to generate busy and 
reject frame commands. 

14. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 13, the "non-core function port" 
port controller further comprising software for ma- 
nipulation of the frame header, and further compris- 
ing the step of queuing the frame back out to the 
original source F__port, and wherein, the source 
F_port continues to time the frame while the original 
frame is queued to the "non-core f unction port", and 
wherein, if the frame is not forwarded within a pre- 
determined period of time, the source F_port makes 
a request to the "non-core function port" port con- 
troller not to forward the original frame to the proc- 
essor, and wherein, if the frame does make it the 
processor, and the reject/busy frame is queued 
back to the source F_port, the "non-core function 
port" port controller must tie the frame and discard 
it if necessary. 

15. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 14, further comprising a "non-core 
function port" timer that times the time between 
when the frame was first queued to the "non-core 
function" port and when it was actually delivered to 

. it. 

16. The fibre channel switch employing a distributed 
source and destination queuing algorithm as 
claimed in claim 5, further comprising a processor 
and the buffer information passed to the "non-core 
function port" further comprises a time stamp, 
wherein, the processor time stamps frames upon 
receipt, and wherein, a time out value is calculated 
that ensures that the frame is discarded within 
R_A_TOV. 



12. The fibre channel switch employing a distributed 
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(54) Fibre channel switch employing distributed queuing 



(57) The present invention is a fibre channel switch 
employing a distributed queuing algorithm for intercon- 
necting a plurality cf devices (workstations, supercom- 
puter, peripherals) through their associated node ports 
(NLports) and employs a fabric having a shared memory 
coupled to a plurality of fabric ports (F_ports) through a 
bi-directional bus over which memory addresses, frame 
data and communications commands are transmitted. 



Each F_port includes a port controller employing a dis- 
tributed queuing algorithm associated with a control net- 
work for communicating commands between the ports 
related to when and where frame transfers should be 
made, wherein the bi-directional bus provides an inde- 
pendent data network for access to the shared memory 
such that frames can be transferred to and from the 
shared memory in response to port controller com- 
mands. 
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